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ABSTRACT 

In order to put MIDI/ VLTI observations of AGNs on a significant statistical basis, the number of objects had to 
be increased dramatically from the few prominent bright cases to over 20. For this, correlated fluxes as faint as 
« 150 mJy need to be observed, calibrated and their errors be estimated reliably. We have developed new data 
reduction methods for the coherent estimation of correlated fluxes with the Expert Work Station (EWS). They 
increase the signal/noise of the reduced correlated fluxes by decreasing the jitter in the group delay estimation. 
While correlation losses cannot be fully avoided for the weakest objects even with the improved routines, we 
have developed a method to simulate observations of weak targets and can now detect — and correct for - 
such losses. We have analyzed all sources of error that are relevant for the observations of weak targets. Apart 
from the photon-noise error, that is usually quoted, there is an additional error from the uncertainty in the 
calibration (i.e. the conversion factor). With the improved data reduction, calibration and error estimation, we 
can consistently and reproducibly observe fluxes as weak as ~ 150 mJy with an uncertainty of ~ 15 % under 
average conditions. 
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1. INTRODUCTION: SCIENTIFIC MOTIVATION 

There is little doubt that the energy-releasing central engine of an Active Galactic Nucleus (AGN) consists of a 
black hole surrounded by an accretion disk that produces copious amounts of radiation from infrared to X-Rays. 
At a distance of several milli parsec, gas clouds get irradiated by this light and show Doppler-broadened broad 
emission lines that are observed in the direct light in so called "type 1" AGNs. In others, called "type 2" , only 
narrow emission lines are observed in the direct light but the broad lines are weakly detectable in polarized, i.e. 
scattered, light. Unified schemes of AGNa^ ascribe this difference in the optical spectra of AGNs to different 
lines of sight towards the symmetry axis of the system and require a toroidal dusty structure - the so called 
"torus" - that intercepts the radiation from the accretion disk and reprocesses it in the infrared. 

In observations with a single 8m telescope ("single-dish observations"), the torus is unresolved. While single- 
dish spectra^"^ are able to constrain a number of parameters for models of clumpy toripEJEI it is challenging to 
isolate the torus emission from the emission of a nuclear starburst and from synchrotron radiation of a nuclear 
jet in unresolved observations. In order to resolve the torus emission, spatial resolutions of better than 100 milli 
arcseconds (mas) are needed. The MID-infrared Interferometric instrument (MIDI) at the Very Large Telescope 
Interferometer (VLTI) on Cerro Paranal, Chile, is worldwide unique to observe at such high resolutions in the 
atmospheric N band (A s=s 8 - 13 yum) where the torus SED peaks. 

The MIDI AGN programme has found parsec-scale dust structures that can be associated with the "torus" 
from the unified modelP^ A study using GTO time^l showed that objects fainter than the two brightest targets 
can still be observed and resolved with MIDI and a recent study of six type 1 objects^ hinted at more compact 



* Based on observations at the European Southern Observatory VLTI, Large Programme ID 184.B-0832 




Figure 1. Typical background in chopped acquisition images of a weak target. These two images were taken nearly 
simultaneously in the night of 2010-01-31 at 4:45 UTC on NGC 4507 with 8000 exposures of 4 ms. The target is a type 
2 AGN with Fv(12fj,m) « 0.6 Jy. Not only is the background still very high and the target only barely visible near the 
center of beam B, but the background in beam A is also very inhomogeneous, thereby completely masking the target. 



dust structures for higher AGN luminosities. However, only few sources have been studied initially and the 
implications on the prevalent astrophysical questions - e.g. are "type 1" and "type 2" tori different? Is there a 
connection between torus properties and AGN activity? How does the torus size vary with AGN luminosity? 
- were limited by the low number of sources. It was clear that a large and systematic observational campaign 
was needed to collect the basic observational information necessary to understand dusty tori on a statistical 
basis. This is the aim of the MIDI AGN Large Programme (LP). It was also clear, however, that the sample size 
can only be increased by observing targets that are fainter than ESO's official limiting magnitude for visibility 
observations with MIDI on the UTs (N — 4 mag or F v = 1 Jy for an unresolved object). 

The data and first scientific results of the MIDI AGN LP will be presented elsewhere (L. Burtscher et al., 
in preparation). The topics of this proceedings article are the observing strategy and data reduction method 
necessary to successfully observe and calibrate faint (100 mJy < F v < 1 Jy for an unresolved source) objects 
with MIDI. 

This paper is structured as follows: First we describe what an observer can do at the telescope to ensure 
that faint targets can be optimally calibrated. Next, an outline of the data reduction method is given and 
the modifications and specific problems for weak targets are described. Lastly, we discuss an improved error 
estimation for weak sources and summarize. 

2. OBSERVING METHOD 

A full observing sequence with MIDI consists of the following steps for both the calibrator and the science target: 

1. Acquisition images can be taken upon the observer's request in order to verify that the beam overlap is 
good (see Fig. [TJ. 

2. The fringe search is used to locate the position of zero optical path difference (ZOPD) based on an initial 
guess using a baseline model. 

3. During fringe track, the fringe pattern is scanned with the MIDI-internal piezo motors and the fringe 
signal is recorded. 

4. Lastly, two photometry observations (— single-dish spectra; one per telescope) can be taken to determine 
the total flux (density) of the target. 



As one can see in Fig. [TJ one cannot hope to constrain the overlap or judge other observing conditions using 
acquisition images for faint targets. The single-dish spectra ("MIDI photometries") are also very hard to calibrate 
since they suffer from the same strong and variable background that can usually not be completely removed. 
While the origin of these fluctuations is still unclear, they most likely arise inside the VLTI optical train and 
may arise from emission from the telescope structure reflected into the optical path, imperfect corrections by 



the AO-system MACAO or turbulence in the VLTI tunnels. Many such observations have to be performed to 
obtain a good estimate of the spectrum of the source. The uncertainty in the single-dish spectra is probably 
best described as a composite between photon noise and background fluctuations, where the latter are dominant 
for the weakest observable sources.^ Since the uncertainty in MIDI photometry is so large for weak sources, it 
is advisable to skip this step in the observing sequence alltogether. This changes the way, the data have to be 
calibrated. 

The default calibration for MIDI is, for each wavelength bin, 
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where V is the calibrated visibility of the target and Vtargct, Vns are the raw visibility of the target and 
the instrumental visibility as measured from the (unresolved) calibrator, respectively. C and P stand for the 
correlated flux and photometry counts of the target and calibrator, respectively. The index stands for the 
(hypothetical) "true" count rate without atmospheric and VLTI absorptions and T and T 1 are the transmission 
functions at two instants in time. It is assumed that the same T applies for both the correlated flux and the 
photometry observations, since they are taken very close in time, i.e. both T and T" cancel out. Instrumental 
effects, that change much slower than the transfer function, are removed by observing a calibrator at a later 
time. However, for weak targets, this calibration method is problematic since the uncertainty in the photometry 
is very large. 

An alternative calibration method ("direct flux calibration") exists, 
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where F v is the correlated flux of the target, F v>c is the flux of the calibrator and V ca \ the visibility of 
the calibrator (typically very close to unity in the N band). With this calibration method, the noisy total 
flux measurement of the target, P t , is not required anymore. On the other hand, since the division involves 
two quantities taken many minutes apart (the correlated flux of the target and of the calibrator), the transfer 
functions can no longer be assumed to be identical and one needs to estimate the fraction T/T'. 

Therefore, the observing sequence should be optimized to switch as fast as possible between target and 
calibrator fringe track. This can be achieved by concentrating on fringe track observations and omitting the 
single-dish observations (acquisition, photometry) . Fringe searches should only be taken if the baseline model is 
not sufficient for MIDI to find the fringe during the first few seconds of the traclfj]. 

If only fringe tracks are taken, the time for a calibrated (it, v) point can be reduced to approximately 16 
minutes, i.e. the time for slewing, acquisition and integration can be reduced to approximately 8 minutes per 
target, under average conditions (see Fig. [5]). Thus, a sequence of CAL-SCI-CAL-SCI-CAL, i.e. two science 
target fringe tracks embedded in calibrator tracks, takes about the same time as the currently given time for a 
calibrated (u, v) point (50 min)P^ but is a much better estimate for the correlated flux of a weak target than 
the default observing procedure. The optimized observing procedure, involving only correlated flux, has recently 
been implemented by ESO as "correlated flux mode" 

In order to calculate a visibility from F v , a single-dish spectrum, e.g. from VISIR/VLT, is required in addition 
to the MIDI observations. 

^The fringe search may be omitted for both the calibrator and the target if the baseline model is excellent, but can in 
most cases be omitted for one of the two. Usually calibrator and science target are close on sky so that the differential 
deviations from the baseline model are within the coherence envelope. The ZOPD position may be found by the MIDI- 
internal fringe tracker in PRISM mode (coherence length A co h = R ■ A ~ 300/im ) even when starting the track as far 
away from ZOPD as 4 A co h for bright sources (calibrators). If the fringe search is omitted, it is advisable to set the OPD 
position where the fringe track starts to a lower OPD value than the previously found value of ZOPD. This way, MIDI 
will "run into the fringe", since the MIDI-internal fringe tracker starts increasing the OPD if the fringe is not found. 



3. DATA REDUCTION FOR WEAK TARGETS 

Weak source observations with MIDI are best reduced using the method of coherent integration^ as it provides 
a higher signal/noise compared with the technique of power spectrum estimation for each frame. The former 
method has the additional advantage that any noise terms average to complex zero, whereas in the V 2 case, a 
constant offset remains that is hard to determine for weak sources. The Expert Work Station (EWS) currently 
m version 2.0 (betajl implements the method of coherent integration for MIDI data. The software is free under an 
open source license and its source can be downloaded from |http://home.strw. leidenuniv . nl/ ~ j aff e / ews / index . html| 
where a technical description of the routines is also given. 

The data reduction for MIDI data with EWS consists of the reduction of the fringe track data and the 
reduction of the single-dish "photometry" data (if available). The procedure is then repeated for the calibrator. 
The photometric data reduction has been described in detail and there is not much one can do to improve the 
MIDI photometry for weak sources. The determination of the correlated flux on the other hand has changed 
significantly since the original description's] here the new features of EWS 2.0 are highlighted. 

3.1 Outline 

The data- and computation-heavy processing steps are implemented as C routines oir. . . and the pipeline 
scripts and interactive tools are written in IDL. The new features in EWS 2.0 are available in the IDL procedure 
f aintVisPipe, the traditional routine remains available as midiVisPipe. A comparison between the group 
delay determination of the two routines for simulated weak data (see Section 1372"]) is shown in Fig. [2j The data 
reduction steps are: 

1. Raw data — > oirldCompressData — > compressed. fits 

apply mask to raw data to reduce two-dimensional detector image to one-dimensional spectrum. New: An 
optimized mask can be used to increase the signal/noise of the extracted spectrum. This mask is generated 
from the calibrator's "fringe image" , i.e. a coherent image of the detector (for details see the IDL routine 
midiMakeMask). This is particularly useful if no "photometry" observations have been made so that the 
default mask creation algorithm fails. 

2. compressed. fits — > oirFormFringes — > fringes. fits 

apply high-pass filter to remove non- modulated noise. For very low S/N sources, the data should be taken 
in "offset tracking" mode where the OPD does not cross ZOPD, but is modulated a few wavelengths offset 
from ZOPD. This has the advantage that the target spectrum becomes spectrally modulated. Thus, by 
subtracting the average from each frame, the background can be further suppressed. 

3. fringes. fits —> oirRotatelnsOpd — > insopd.fits 

remove instrumental OPD variations (data now complex) . The instrumental OPD variations are shown as 
a blue zig-zag line in Fig. [2] 

4. insopd.fits — > oirFGroupDelay — > groupdelay 1 .fits 

compute Fourier transform and searches maximum Fourier power in delay space per frame to determine 
the group delay. New: Several minor and major changes. The most significant change to the pipeline is 
that this function can now be called twice (if the twopass option is enabled). Most of the new features 
are only relevant in the second iteration (see below). The Fourier transformed raw data are shown as the 
backdrop image in Fig. [2l 

5. groupdelay 1. fits oirPowerDelay — > powerdelay.fits 

New function: make a crude estimate of the group delay for very low S/N data. Since the complex signal 
is uncorrelated over times larger than about the atmospheric coherence time (« 20 ms at 10 /im), the 
estimate of the group delay is made incoherently on the amplitude of the complex data over a much longer 
time range (default 16 s). This crude estimate is used in the next step to constrain the range in which a 
finer group delay search is performed. 



For this article, the EWS "snapshot" version of 25 Jan 2012 was used. 



6. groupdelayl.fits, powerdelay.fits —> oirFGroupDelay (2nd pass) — > groupdelay.fits 

New: If called twice, this function searches for the maximum in the complex smoothed image in a region 
(default: ± 40 fim ) around a crude estimate of the group delay determined by powerdelay.fits. This takes 
into account the empirical knowledge that the true position of ZOPD in the N band typically does not 
vary more than ~ 1 /im /s and has the advantage of avoiding noise peaks in very low S/N data. 

In order to increase the S/N for the group delay estimation, many frames (typically « 20) have to be 
averaged together. To maximize the S/N, we now allow the group delay to vary within the smoothing 
interval. The found group delay is finally median smoothed, in order to suppress unphysical OPD jumps. 
Additionally, a previously existing bias in the group delay and phase estimation is reduced by excluding a 
certain time interval around the data currently being processed (see the EWS webpage for details). The 
found group delay is shown as the red (bright source) and yellow lines (faint source) in Fig. [5] 

7. fringes. fits, groupdelay.fits — > oirRotateGroupDelay — > ungroupdelay.fits 

remove both the known instrumental delay and the group delay as determined above and estimate a phase 
offset induced by water vapor dispersion. 

8. fringes. fits, groupdelay.fits — > oirAutoFlag — > flag. fits 

determine the quality of each frame. The difference between the estimated OPD and the tracking delay of 
a good frame must not be larger than a certain value (default: 100 /im), but it must also not be smaller 
than a certain value (default: 10 fim), in case the source has been observed in "off-zero tracking". New: 
The local jitter must not be larger than a certain value (default: 1.5 jum) to avoid significant correlation 
losses. Frames / groups of frames flagged as "bad" are shown with orange dots / lines in Fig. [5J 

9. ungroupdelay.fits, flags. fits — > oirAverageVis corr.fits 
coherently average all frames flagged as good. 

In essence, the new routines keep more frames for the averaging process at the end and remove biases in the 
data reduction process that become relevant for weak sources. 

3.2 Estimation of correlation losses 

For coherent integration, i.e. the data reduction method outlined above, a robust determination of the group delay 
for each frame is required since jittering leads to a reduction of the estimated correlated flux, so called correlation 
losses. A Gaussian error on the group delay of standard deviation ctgd leads to a reduction of the correlated 
flux by the factor-^ exp(— 2(7tctgd/A) 2 ), e.g. ogd = 0.5/im lead to 5 % correlation loss and ctgd — 1-6/im lead 
to 40 % correlation loss at A = 10/im . 

Since, even for weak science targets, one typically uses bright (F v > 5 Jy) calibrators to keep the errors in 
the calibration as small as possible, the group delay estimation for the target observation has a larger ctgd than 
that of the calibrator observation and the correlation loss is not calibrated. 

One way to address this problem is to observe calibrators of similar brightness as the science sources to study 
correlation losses. While this has been used successfully to show that correlation losses are below 5% for stars 
with fluxes as low as w 300 mJyJSI correlation losses for the faintest science targets observable with the VLTI 
cannot be tested with this method since, for very faint stars, precise mid-IR flux estimates are not available. The 
12 fim fluxes from the IRAS Faint Source Catalogue are typically uncertain by more than 10% for fluxes lower 
than 200 mJy and AKARI/IRC Point Source Catalogue flux uncertainties at 9 /jmare still considerably larger 
than 5 % for fluxes as weak as 200 mJy. However, as is shown below, significant correlation losses only appear 
at such low fluxes. 

A different approach to estimate correlation losses in the data reduction of faint targets is to use a bright 
target observation and "dilute" it. This is done by adding to a noise file the raw data of a target with known 
flux F u c (i.e. a calibrator), multiplied by a factor / < 1 to simulate an observation of a known, weak input flux 
F[ n = f ■ F v>c . In this way not only the input flux is precisely known but also a very accurate estimation of the 
group delay from the reduction of the undiluted target. Of course this method cannot simulate the AO and lab 
guiding (IRIS) performance of a weak AGN observation, but this is also not possible by observing faint stars 
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Figure 2. Estimation of group delay with midivispipe (top) vs. faintvispipe (bottom). The backdrop images are identical 
(but have different sampling) and are the smoothed Fourier transforms of each frame after derotation of the instrumental 
delay. They show data from a bright calibrator, diluted to represent a 150 mjy source (see Section f3 . 2 f) . The red line is 
the "true" group delay as determined from the undiluted calibrator data; the yellow line is the group delay that the EWS 
routines midivispipe and faintvispipe found, respectively. Note that the old routines (top) produce an estimation of group 
delay for each frame whereas the new routines (bottom) only store an average value every few frames. The blue zig-zag 
pattern illustrates the modulation of the MIDI-internal OPD during the integration. Orange dots / lines are plotted when 
a frame / group of frames has been flagged as bad by oirAutoFlag. The calibrator data is from 2011-04-20 / 03:04:36 
and the noise was extracted above the spectrum of the weak science observation at 02:46:19 of the same night. 
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Figure 3. Recovered flux _F ou t as a fraction and function of input flux F[ n for our dilution experiment and for the control 
experiment. The colors denote the wavelengths 8.5 /im (blue / purple), 10.5 fim (green / cyan) and 12.5 /im (red / orange) 
for the case with diluted and undiluted group delay estimation, respectively (see text); for each value of -Fin, the symbols 
for the three wavelengths have been shifted slightly for better readability. In total, 62 calibrators in three nights have 
been diluted to 100, 150, 200, 300, 400, 500 and 1000 mjy and the output flux has been determined as a function of input 
flux relative to the 1000 mjy experiment. 
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(faint data + faint GD) -Pout /-Pin (faint data + true GD) 

10.5 /im 12.5 /im 8.5 /im 10.5 /urn 12.5 /im 



0.963±0.003 
0.938±0.004 
0.894±0.005 
0.800±0.007 
0.724±0.008 
0.641±0.009 



0.973±0.003 
0.953±0.004 
0.920±0.006 
0.842±0.007 
0.777±0.008 
0.708±0.012 



1.005±0.001 
1.008±0.001 
1.012±0.002 
1.020±0.003 
1.029±0.004 
1.046±0.006 



1.000±0.001 
0.999±0.001 
0.999±0.002 
0.998±0.003 
0.998±0.004 
0.996±0.007 



1.002±0.001 
1.003±0.002 
1.004±0.003 
1.007±0.005 
1.010±0.006 
1.016±0.010 



Table 1. Correlation losses as a function of wavelength and input flux for the case with diluted and undiluted group delay 
estimation, respectively (see Section l3.2p . The numbers quoted here depend on data reduction parameters. They have 
been computed using all 62 calibrator observations of 2010-03-26, 2010-05-27 and 2011-04-20 and with the EWS snapshot 
version 2012 Jan 25. The uncertainties are given as the error of the mean. 



since stars have blue infrared colors, while AGNs are red. As the various VLTI subsystems (Adaptive Optics, 
lab guiding) operate on visual or near-infrared light, they work better for weak stars than for weak AGNs. 

The result of such a simulated observation of a weak target is shown in Fig. [2] where the backdrop image 
is from the observation of a bright calibrator star that has been mixed with noise in such a way to simulate a 
source with a flux of 150 mjy. It can be seen that the traditional routine (top image) has significant problems 
in finding the true group delay whereas the optimized routine has lower scatter so that less frames are flagged as 
bad. However, as can be seen in the lower part of Fig. [2] there are still significant deviations from the true group 
delay. They lead to reduced correlated fluxes compared to the known input flux for very weak sources as can be 
seen in Fig. El I n this experiment, 62 calibrators of three nights have been diluted to represent weak targets with 
100 - 1000 mjy of correlated flux and the correlation losses relative to the 1000 mjy case have been determined 
at three wavelengths (8.5, 10.5, 12.5 /xm). It can be seen that the decorrelation is stronger for the blue than for 
the red part of the spectrum, as expected, but that the spread in decorrelation is larger at the long-wavelength 
end. 
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Figure 4. Correlated flux count rate as a function of wavelength for three different targets of the night of 2011-08- 
17: a bright calibrator (06:26:11, left panel), a good observation of a very faint target (middle, NGC 7469 at 06:36:38, 
correlated flux at 12 /jmRi 250 mjy) and a bad observation of the same target (right, 08:39:24). To determine the quality 
of the reduced data, the flux is interpolated between about 9.0 and 10.3 /im (interpolation regions marked with red 
lines) to estimate the "continuum" flux outside the atmospheric ozone absorption feature at 9.6 /im (orange). The linear 
interpolation is shown in green and the flux inside the feature as a fraction of the interpolated flux at this wavelength is 
printed in the lower right corner of each panel. Good observations typically have values smaller than 0.76 

We tested our dilution procedure by reducing a diluted input file with the group delay (and phase) estimation 
from the undiluted file and found no correlation losses (as expected). This means the reason for the losses is 
really the erroneous determination of group delay and phase in the weak sources and not caused by the dilution 
procedure itself. The correlation losses and the numbers for the control experiment are compiled in Table [TJ 

For the weakest sources, we therefore correct for the decorrelation losses by multiplying the fluxes that the data 
reduction routine finds with a decorrelation correction factor which we derived empirically from 62 observations 
of calibrators in three different nights (see Fig. [3] and Tabled]). Since the spread in F ou t/-Fin is approximately 
the same for the dilution experiment with diluted and original group delay file (the blue/purple, green/cyan and 
red/orange pairs), we attribute this spread to the usual photon noise error that is already included in the error 
budget and derive the error for the decorrelation correction as the error of the mean of all realizations. This 
error is very small (< 1% for all fluxes, see Table [TJ, it can be neglected for our error estimation (Eq. [TJ. 

3.3 Data selection / quality control 

Apart from the frame selection in EWS, which automatically de-selects frames for the averaging process if 
the group delay estimation is likely to be wrong, we also introduce a track selection using the atmospheric 
ozone absorption feature at 9.6 /mi. Any radiation from outside the earth's atmosphere must have this feature 
imprinted on its mid-IR spectrum leading to a reduction in flux at approximately this wavelength. We estimate 
the continuum flux at this wavelength by interpolating between two wavelengths regions that are unaffected by 
atmospheric ozone absorption and determine the count rate in the feature as a fraction of the interpolated count 
rate (see Fig. [4j- If this fraction is larger than a threshold value, the flux is not dominated by emission from 
outside the atmosphere and the observation is flagged as "bad". We found that a threshold value of 0.76 gives 
results that are most consistent with other estimators of data quality. 

We tested to additionally select data by seeing and airmass, however the simple "ozone test" was sufficient to 
de-select most bad fringe tracks. Additionally a few tracks were de-selected manually where clouds might have 
affected the flux, seeing was excessively large (> 2") or the signal/noise was extremely low. 

4. ERROR ESTIMATION 



For bright sources, the uncertainty in the correlated flux can be estimated by dividing the frames to be averaged 
for the estimation of the correlated flux in a number of bins (default: 16) and by determining the rms of these. 



This is a good approximation of the photon noise error. However, it does not take into account the uncertainty 
in the conversion factor in the case of direct flux calibration and it is not corrected for possible correlation losses. 

4.1 Conversion factor uncertainty 

For faint sources, the "direct flux calibration" method is preferable compared to the visibility calibration since it 
avoids the noisy measurement of the total flux (see Section[5]). However, the flux calibration method is sensitive to 
variations in the atmospheric and VLTI transfer function, i.e. the conversion factor. Using the standard observing 
scheme, it is only measured every hour which leaves a significant uncertainty about the behavior of the conversion 
factor between the calibrator and the science observation. When omitting all single-dish observations and only 
observing fringes, the conversion factor can be sampled much more densely and a more accurate estimate of its 
variance can be obtained (see Fig. [5J. We use the conversion factor of the calibrator closest to the science object 
in time, airmass and distance on sky and estimate its error, ctcf-, as the standard deviation of the conversion 
factor derived from all measurements over the night. Variations of the conversion factor with airmass contribute 
little to its total scatter. We nevertheless remove them by fitting a line to the log CF - airmass relation and 
subtracting the value of this function for each measurement before calculating the standard deviation. 

During the course of the MIDI AGN Large Programme, the relative error of the conversion factor was as 
low as « 3 % for excellent nights and as large as ps 30% in bad nights. The median airmass-corrected value 
of the relative conversion factor error was 8.9 %. It is typically larger at the red end of the atmospheric N 
band. For most observations, this is the dominant source of error and we therefore investigated correlations 
of the conversion factor with other observables that are sampled more frequently by the DIMM in the visual, 
such as the seeing, the atmospheric coherence time To and the sky transmission (Fig. |6|) . It can be seen that 
correlations in the expected sense do exist (lower conversion factors for larger seeing, smaller tq and lower sky 
transmission), but that the correlations are weak and have very strong scatter making them unusable to reduce 
the conversion factor error. Possible other correlations include the precipitable water vapor (PWV) above the 
observatory. We investigated this and found another weak correlation in the expected sense, but since the PWV 
was (until recently) only monitored once per night or more rarely, it is hard to constrain this correlation, if it 
exists. 

4.2 Error estimation for averaged fluxes 

For very weak targets, often only fluxes at a few points in the atmospheric N band are given, e.g. at 8.5 ± 0.2 
/jm and at 12.5 ± 0.2 /im. Our investigations have shown that, in addition to the photon noise error that is 
returned by EWS, a p hot, the calibration uncertainty is a major source of error and has to be taken into account. 
We estimate the calibration uncertainty as the (airmass-corrected) standard deviation of the conversion factor 
per night (and per baseline) cjcf- The error of the averaged flux is then 

a 2 = 1/N ■ a 2 phot + a 2 CF (1) 
where N is the number of wavelength channels that have been averaged. 

This treatment of errors gives consistent results for sources as weak as « 150 mJy, e.g. for the MIDI AGN 
Large Programme source NGC 5995 (Fig. [7|). For this source we fitted the data to a simple one-dimensional 
visibility model of an unresolved point source and a resolved source of a Gaussian intensity profile (similar to 
a one-component power-law intensity profile) . The spread of the data about this model is compatible with the 
error bars derived using the error calculation presented above, i.e. the % 2 is approximately equal to the number 
of degrees of freedom. 

5. SUMMARY AND APPLICABILITY TO OTHER TARGETS 

The weakest objects that are observable with MIDI at the VLTI require special observing and data reduction 
methods in order to limit and reliably estimate the otherwise large errors. The largest improvement is achieved 
by calibrating correlated fluxes directly (instead of visibilities). In order to limit the uncertainty due to the 
sometimes very variable transfer function, the target and calibrator observations should be taken as close in 
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Figure 5. Correlated flux conversion factor (counts/(Jy s px)) as a function of time for three nights: 2010-08-25 (top), 
2011-04-20 (middle), 2011-08-17 (bottom). The colored diamonds show the conversion factor at 8.5 (blue), 10.5 (green) 
and 12.5 /^m(red), the small black arrows indicate the times at which science observations have been taken. Only with a 
dense sampling of the correlated flux can the stability of the conversion factor be estimated reliably. In 2010-08-25 the 
(airmass-corrected) standard deviation at 12.5 micron was 8.1 %, but is badly sampled and therefore a bad estimate for 
the calibration uncertainty due to the direct flux calibration. In 2011-04-20 it was 2.2 % and in 2011-08-17 it was 16.1 %. 
Since these nights have been densely sampled, these numbers are more trustworthy to use as calibration uncertainty. 
In the night of 2011-04-20, where only correlated fluxes have been observed (no acquisition, almost no fringe searches and 
no photometries), a total of 14 calibrator observations and 36 science observations have been taken in a little less than 
6.5 hours, leading to the above quoted number of 8 minutes per observation. 
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Figure 6. Correlated flux conversion factor (counts/(Jy s px)) as a function of DIMM seeing (left), DIMM to (center) and 
DIMM flux rms (right), all measured in the visual. The latter can be considered as a proxy for the cloud coverage. Red 
and blue crosses denote the conversion factor values at 12.5 and 8.5 /im, respectively. They are offset by 1000 counts/(Jy 
s px) for clarity. There are weak correlations in the expected sense (higher conversion factors for better seeing, larger to, 
lower cloud coverage), but the correlations are weak and there is large scatter. The data show more than 600 calibrator 
measurements from 2005 - 2011. 




Figure 7. Correlated flux as a function of projected baseline length for the Seyfert 2 galaxy NGC 5995. The two points at 
zero baseline are total flux measurements from MIDI (triangle, large error bar) and VISIR (diamond). The four colored 
points represent correlated flux observations at A =12.3 /imrestframe at different position angles (see color bar at the 
right) in the nights of 2010-03-26 (Baseline: 55m), 2010-03-27 (100 m) and 2011-04-17 (60m and 70m). The error bars 
of the correlated flux measurements take into account the three noise and uncertainty sources: photon noise, conversion 
factor variance and the uncertainty in the correction of correlation losses. They demonstrate that consistent results can 
be achieved with MIDI using our data reduction and calibration methods for fluxes as low as ~ 150 mjy. 



time as possible which is achievable by concentrating on only taking correlated fluxes. In the data reduction, 
the biggest challenge for weak sources is an accurate estimation of the group delay. Progress has been made by 
implementing an iterative approach for the group delay estimation and especially by simulating OPD changes 
during each smoothing interval. 

A method has been developed to robustly test the data reduction method for weak sources by generating 
artificially diluted data of a real observation and comparing its reduction with the one using the original data. 
This way, significant correlation losses have been uncovered for fluxes lower than 300 mJy. They can be corrected 
for by applying a decorrelation correction factor that depends both on the observing conditions and the data 
reduction parameters. 

After both photon noise and conversion factor errors have been taken into account and after correction of 
correlation losses, consistent results are achieved for weak targets. Using the methods described here we can 
reproducibly observe objects as faint as w 150 mJy with an uncertainty of « 15 % under average conditions. 

Some of the methods presented here are a part of EWS and are available from the previously quoted web 
page; the higher level methods, that require a knowledge of all observations of a night, such as the determination 
of conversion factor variations and decorrelation correction factors have not (yet) been implemented in EWS. 
They are available as a Google code project and can be downloaded from |http: / / code.google.com/p / miditools /} 
Interaction with the authors is highly encouraged if you plan to use these scripts. 

The observing and data reduction method as well as the error estimation are not specific to observations of 
weak AGNs but may be applied for MIDI observations of any weak target. With PRIMA becoming available 
as an external fringe tracker for MIDI observations weak targets will be observed more frequently with MIDI 
and a precise estimation of the measurement uncertainties is needed. 
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